The phrase "unbuttered side" refers to a piece of toast or bread that doesn't have any butter or spread on it.